Problem Note 63423: Using the ImportPackage could cause the metadata server cluster node to fail and lose quorum
You might encounter a problem in which metadata server cluster nodes do not successfully sync with each other. This problem typically occurs under the following conditions:
- You import a package that requires a large number of changes to the metadata servers. The number of changes exceeds the limits of the SAS IOM system.
- You use a SAS® 9.4 deployment that contains a metadata server cluster configured with three or more cluster nodes that are in quorum and running normally.
- The master node is redirecting client requests to two or more slave nodes in the cluster.
When you encounter this problem, you might see messages similar to the following:
ERROR - Error importing metadata. Reason: The DoRequest request failed because the server is paused for OFFLINE use.
INFO - The import process has finished with errors.
The metadata server might encounter an access violation:
2018-09-06T14:15:47,890 ERROR [00000041] :sas - AccessViolation (6) encountered in CONTEXT 00000028 using cookie 5.
Other metadata server logs might indicate that quorum is lost and achieved:
2018-09-06T14:16:21,777 INFO [00000358] :sas - The cluster has lost quorum and is now OFFLINE
2018-09-06T14:16:21,842 INFO [00000354] 5:sas - Setting the master node to SASMeta - Metadata Server Node 2.
2018-09-06T14:16:21,952 INFO [00000376] :sas - The cluster has achieved quorum and is now ONLINE.
Workaround
If the two remaining servers are in quorum and the other system is down or has failed, you can work around the issue by completing these steps:
- Click Run Backup Now in SAS® Management Console with only the two nodes in quorum.
- Run ./MetadataServer -recover on the failed node to start it again.
In SAS® 9.4M6 (TS1M6), the import package checks the amount of changes and returns with the following error if there are too many changes:
ERROR - Error importing metadata. Reason: This request requires changing too much metadata to be safely committed. Please try again with a smaller request.
INFO - The import process has finished with errors.
Note: This issue is fixed in SAS 9.4M6.
Operating System and Release Information
SAS System | SAS Metadata Server | z/OS | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft® Windows® for x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows 8 Enterprise 32-bit | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows 8 Enterprise x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows 8 Pro 32-bit | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows 8 Pro x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows 8.1 Enterprise 32-bit | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows 8.1 Enterprise x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows 8.1 Pro 32-bit | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows 8.1 Pro x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows 10 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows Server 2008 | 9.4_M5 | | 9.4 TS1M5 | |
Microsoft Windows Server 2008 R2 | 9.4_M5 | | 9.4 TS1M5 | |
Microsoft Windows Server 2008 for x64 | 9.4_M5 | | 9.4 TS1M5 | |
Microsoft Windows Server 2012 Datacenter | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows Server 2012 R2 Datacenter | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows Server 2012 R2 Std | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows Server 2012 Std | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Microsoft Windows Server 2016 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Windows 7 Enterprise 32 bit | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Windows 7 Enterprise x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Windows 7 Home Premium 32 bit | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Windows 7 Home Premium x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Windows 7 Professional 32 bit | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Windows 7 Professional x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Windows 7 Ultimate 32 bit | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Windows 7 Ultimate x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
64-bit Enabled AIX | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
64-bit Enabled Solaris | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
HP-UX IPF | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Linux for x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
Solaris for x64 | 9.4_M5 | 9.4_M6 | 9.4 TS1M5 | 9.4 TS1M6 |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
When you attempt too many changes to the metadata, the metadata server might fail.
Type: | Problem Note |
Priority: | medium |
Date Modified: | 2019-11-13 15:26:29 |
Date Created: | 2018-12-21 10:57:09 |